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Consiaer  the  problem  of  .Tiinir.i'^ing  a  linear  function 

^b.x^  subject  to  the  conditions 
J  u 


(1) 


^  <=1 


xj>0 


^  *  1|  2|  ...| 


1.  2 


Notice  at  th.e  outset  that  equalities  may  be  adniitted  in  this  forni  by 
writing  each  ec^uality  as  two  ine(iU£lities  v.’ith  reversal  of  signs. 
Furthermore,  tne  problem  may  be  reformulated  so  tnat  orO.y  inequalities 
of  the  form  Xj  >  0  ar*'  nresent,  by  defining  appropriate  new  variables. 
T.hus  it  is  evident  that  the  above  form  is  simply  one  standard  version 
of  a  general  problem  involving  both  inequalities  and  eciualities. 

In  principle  the  solution  of  the  problem  stated  is  trivial. 
Observe  tliat  th.e  set  of  inequalities  defines  in  n^-space  a  corivex 
polyhedron  (possih'ly  empty)  with  at  most  mj  ♦  faces  of  dimension 
in^  “  1  ,  and  that  the  minimam  problem  is  th:t  of  finding  an  extreme 
point  of  the  polyhedron  in  som.e  .lirection.  In  general  the  extremum 
will  be  tiken  on  c.t  a  vertex,  so  the  probl*^m  is  that  of  evaluating 
Eb  X,  at  the  vertices  and  choosing  that  vertex  which  yields  the 
s.riallest  v.ilue .  ..  vertex  .s  of  course  .t  point  .t  which  a  subsystem 

(of  rank  ;  of  the  ine  .ualities  is  satisfied  exactly  equalities, 
witii  tlio  remainisg  inequalities  satisfied,  Ir.  principle,  then,  one 
could  invert  all  subsy r'terns  of  rank  :n^  ,  t.srowing  out  tnose  w,  ose 
solutions  fail  to  .  .tisfy  ti.r  remaining  inequalities,  aiid  tnen  evaluate 

Z^b.x.,  It  i;  cl>;ar  thit  thir  is  rot  a  sracticil  .method  le/onU  the 

j  j _ 

Tl  )  T’.eoret i cal  h  ick  -roun  i  of  ti.is  i  u;  er  is  base.!  on  work  ol  li...eyl, 

v  .Neu.  i-ann ,  Vi.le,  Tncker,  G.Dir.txig,  m!  other.'',  on  cor.ve--'  poly.no  irs 
uvi  on  th^^orv  of  h^arnes. 


smallest  values  of  rij  riiiti  .  The  practical  difficulties  stem  from 
the  fact  that  the  convex  solyhedron  is  specified  by  its  faces,  whereas 
the  vertices  are  at  the  root  of  the  problem. 

In  pa  5  s  i  u  g.  it  should  bo  rioted  that  the  problem  stated  above 
has  a  very  simple  uuiil  prollem,  obtained  by  transposing  the  matrix  n, 
and  making  a  few  other  obvious  changes.  The  dual  is  the  problem  of 
maxim’ zing  subject  to 


^y^A^j  <  bj  1  i  ■  1,  2,  •••»  m| 


^i  ^ 


>  0 


j  ■  1,  2|  •••» 


The  two  dual  problems  have  the  property  that  if  either  problem  has  a 
solution  so  has  the  other,  and  the  minimum  value  in  one  is  the  maximum 
value  in  the  other.  In  certain  economic  applications  the  solutions  of 
both  problems  are  required. 

Consider  now  the  problem  of  maximizing  min^6j^A^j  subject 
^  2|  rn|  dfid  cIubX  p]rot)lGin  ol* 

minimizing  raaxSlA^j^j  subject  to  "I,  j  "If  rn^. 

This  problem  provides  optimum  mixed  strategies  for  the  zero— sum  game 
with  matrix  A,  where  A^j  represents  the  payment  from  player  1  to 
:  layer  2,  if  player  1  plays  his  i^^  strategy  and  player  2  plays  his 
j^^^  strategy.  The  celebrated  ;  inimax  tl.eorem  of  von  Neumann  says 
that  under  the  conditions  stated 

‘ij  • 


Aj  .  •  Min  Max  ^  . 


Max  Min  , 

^  j  ^  7  i 

The  common  value  is  referred  to  as  the  value  of  tne  -’ame  and  the 

and  ['7ji  of  the  solutions  are  the  o’ timura  mixtures  for  players  1  and  2, 

respectively.  As  in  the  first  protilem  stated  in  this  paper,  ’eon.etrica 


considerations  of  convex  bodies  C)ntribute  to  uriJerstariUing  the  problem 


and  it  turns  out  that  in  'eneral  tlie  problem  is  practically  solved  if 
it  is  kno'.vn  which  subnatrix  of  A  to  Invert. 

There  is  of  course  an  intimate  relation  between  the  theory 
of  ^ames  iroblem  and  the  pro':  lem  first  stated,  although  they  are  not 
quite  identical  problems,  since  the  r:ame  problem  always  has  a  solution, 
while  the  first  problem  does  not  necessarily.  Briefly  SLunmarized ,  the 
f^ame  T)roblem  is  lirectly  a  special  case  of  the  first  problem,  while  the 
first  orobler.i  can  always  be  embedded  in  a  game  i  rob  lem,  whose  solutions 
yield  rolutlor.s  to  the  orif’inal  problem  if  it  ha.s  a  solution.  Thus, 
if  problems  of  one  type  csn  be  solved,  so  can  oroblems  of  the  other 
type . 

Various  iterative  methods  for  solution  of  one  or  the  other  of 
these  nroblems  h.ve  beer»  r^iven  by  von  Neumann,  Jantzig,  and  others, 
nrdiile  some  of  these  metho  is  may  be  practical  over  a  certain  range  of 
problems,  all  of  then,  have  an  apparent  uepenuence,  in  required  number 
of  steps,  of  higher  order  than  the  first  power  of  the  linear  dimensions 
of  thiC  problem.  For  very  larre  matrices  not  possessing  simf)lifying 
special  properties,  such  a  dependence  can  ’  e  a  very  serious  obstacle 
in  the  way  of  getting  numerical  solutions,  i.e  will  describe  briefly, 
for  the  nme  solution,  an  iterative  ;  ch.ene  which  is  quite  different  from 
those  previously  suggested,  in  that  tiie  .i.nount  of  calculation  required 
at  each  iterative  step  is  lirectly  proportional  to  the  linear  dimensions 
of  the  uroblem,  so  tt.at  the  method  has,  a  priori,  some  chance  of 
beatinr  th.e  high  order  dependence. 

The  r  rocedure  to  be  lescriLei  c  .r*  .  ost  easily  be  comprehendea 
by  consi ierlng  the  ;  .  ycnology  of,  let  us  say,  a  statistician  unfamiliar 
v/ith  theory  of  ra.mes.  ./..ch  s  nerson,  iacei  with  repeated  ciioices  of 
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play  of  a  certain  ga;ne,  :r,i^ht  reasonably  be  expected  to  play,  at  each 
opportunity,  that  one  of  his  strategies  which  is  best  against  past 
history,  that  is,  against  trie  mixture  constituted  by  his  opponent's 
plays  to  date,  Such  a  decision  utilizes  information  of  the  past  in 
the  most  obvious  manner.  The  iterative  scheme  referred  to  here  is  Lased 
on  a  picture  of  two  such  statisticians  playing  repeatedly  together.  For 
calculation  purposes  a  slight  moaification  is  introduced  which  has  the 
effect  that  the  two  players  choose  alternately,  rather  than  siraultaneou'  .y. 

Restating  the  method  algebraically,  let  A  be  the  game  matrix, 
let  ij^  and  be  the  n^^  choices  of  strategy  for  the  two  sides,  let 
and  be  the  relative  frequencies  of  strategies  i  and  j  in 
(ii,  i2,  ...»  ij^)  and  (ji,  •••»  respectively,  then  minimizes 

.  This  process  defiries  a 

sequence  i|,  J|,  i^,  J^,  . ,  once  ij  is  chosen  (perhaps  arbitrarily), 

except  for  ossible  ambiguities  of  the  extrema,  ^ny  convenient  rule 
will  do  for  handling  ambiguities.  If  ■  min^^^^'  and 

■  max^A.  •  >0  • ,  it  is  easily  seen  that  V  V  V  where  V  is  the 

n  ^  ij  (  j’  ^  -n  -  -  n, 

value  of  the  .*ame.  The  mixtures  j  are  mixed  strategies, 

and  the  corresponding  Y  and  V  are  tlie  most  favorable  outcomes  ensured 
to  each  player  if  he  uses  the  corresponding  mixture. 

nt  ti.is  moment  not  much  is  rigorously  established  about  the 
properties  of  ti  is  iteration,  except  t)iat  if  it  converges  at  all  it 
converges  to  a  solution  of  the  game  for  each  side.  Of  course  it  would 
be  sufficieiit  If  lim  sun  V  ••  lim  inf  V  .  There  is  conri  ierable  suprort, 
however,  based  on  experience  with  the  method,  and  also  on  the  study  of 
a  related  system  of  differential  equations,  for  tr.e  conjecture  that 
convergence  is  of  the  order  of  1 /n  and  does  not  depend  essentially  on 


E 

i 


‘IJ 


and  i 


n***  1 


maximizes 
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the  si:'o  of  the  Matrix.  If  t;.is  icj  r. o,  it  is  extremely  important  for 
the  relation  of  lar^.e  matricer.,  by  virtue  of  tlie  fact  that  each  iterative 
steur.  requires  oaly  a  number  of  operations  proportional  to  the  linear 
size  of  the  matrix.  Converr^ence  of  oroer  l/n  is  of  course  painful  if 
!’.if;h  accuracy  is  needed.  In  such  cases  it  may  be  possible,  iiowever,  to 
use  a  method  like  this  to  ret  close  to  the  solution,  finisiiing  with  one 
step  of  another  iteration. 

The  accompanying  worksheet  shows  25  steps  carried  out  for  the 
i+  ^  3  matrix 


\  j 

1 

2 

3 

1 

3 

1  .1 

1  .2 

2 

1  .3 

2 

0 

3 

0 

1 

3.1 

4 

2 

1.5 

1 . 1 

Note  that  encii  l^ne  is  obtained  by  adding  to  the  previous  line,  component 

by  compjner.t ,  the  corresponding  row  or  colamn  of  the  matrix,  without 

troublinr  to  livi  ie  by  n.  The  V  and  V  were  calculated  at  each  step, 

by  division  of  the  extrema  by  n,  to  show  the  progress  of  tlie  calculation. 

In  case  of  ties  the  lowest  index  was  taken.  Note  particularly  that 

i'  decreasing  just  about  like  l/n,  in  spite  of  the  excursions 

which  V  and  V  make.  The  initial  choice  of  i i  "2  was  made  deliberately 
n  -n  ' 

ns  an  unfavorible  choice,  with,  respect  to  minimum  guaranteed  payoi'f. 

It  i.  aporonriate  to  resort  *o  this  .lyrnDOsiuiii  that  preliminary 
iiscussi  ns  with  Messrs.  Haar  and  .linger  of  th«  staff  of  the  Harvard 
Cor.putat i on  Laboratory  i.mlicate  tnat  Mark  III  could  carry  out  1000  of 
these  iterative  lines  for  a  /♦0»LU  matrix  in  comfortably  under  an  hour. 

Of  course  the  • roblem  has  not  been  completely  programmed,  but  the  estimate 
i:  ^,•liev^"l  to  1  cor.  servati  ve  . 
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